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METHOD FOR RESTORING COMPRESSED IMAGE OF IMAGE PROCESSING 
SYSTEM AND APPARATUS THEREFOR 

BACKGROUND OF THE INVENTION 

5 

1. Field of the Invention 

The present invention relates to an image process 
technique, and in particular to a method for restoring a 
compressed image by using a hybrid motion compensation 
10 discrete cosine transform (hybrid MC/DCT) mechanism, and an 
apparatus therefor. 

2 . Description of the Background Art 

In general, image compression techniques, such as MPEG1 
15 and MPEG2 employ a hybrid motion compensation discrete cosine 
transform (hereinafter, referred to as "hybrid MC/DCT") 
mechanism in order to improve compression efficiency. The 
hybrid MC/DCT mechanism is roughly divided into an encoding 
process and a decoding process. In the encoding process, an 
2 0 original image is divided into a plurality of blocks in order 
to compress information in a spatial section, a second- 
dimensional discrete cosine transform is performed on each 
block, and redundancy information in the image or between the 
images is reduced by using the correlation on a time axis 
2 5 among the images in order to decrease information in a 

1 



temporal section. In the decoding process, the steps of the 
encoding process are performed in a reverse order. An encoder 
and a decoder are necessary to carry out the hybrid MC/DCT 
mechanism. 

5 Figure 1 is a block diagram illustrating an image encoder 

according to a related art. As shown therein, an input image 
signal is subtracted from an image signal moved from and 
compensated by an image memory 9, passed through a first 
switching unit 2, and inputted to a DCT unit 3. The DCT unit 

10 3 performs a discrete cosine transform on the inputted image 
signal. A quantization unit 4 quantizes the image signal, and 
outputs a DCT coefficient (q) . An inverse quantization unit 6 
inversely quantizes the DCT coefficient (q) , and an inverse 
DCT unit 7 carries out an inverse discrete cosine transform 

15 thereon, thereby restoring the original image signal. The 
restored image signal is added to an image signal restored in 
a previous stage by an adder 8, and inputted to an image 
memory 9. A controller 5 controls switching of the first and 
second switching units 2, 10, and transmits INTRA/ INTER 

2 0 information (p=mtype; flag for INTRA/ INTER) , transmission 
information (t; flag for transmitted or not) , and quantization 
information (qz=Qp; quantizer indication) to a decoder (not 
shown in Figure 1) . The image memory 9 outputs a motion vector 
information (v=MV; motion vector) to the decoder. The DCT unit 

25 3 outputs the DCT coefficient (q) to the decoder. 



However, information of the original image signal is lost 
during the process of coding the image signal described above, 
especially during the quantization process, thereby causing 
blocking artifacts and ringing effects to the image which is 
reconstructed in the decoder. The blocking artifacts imply 
irregularity between the blocks generated due to information 
loss resulting from the quantization of the low- frequency DCT 
coefficients, and the ringing effects results from 
quantization errors of the high-frequency DCT coefficients. 

That is, in accordance with a coding technique using the 
DCT in a coding system of a static image or dynamic image, an 
image is divided into a plurality of blocks, and the DCT is 
performed on each block. On the other hand, when the DCT is 
carried out on the original image, its important information 
is mainly included in low- frequency elements, and becomes 
lesser in high-frequency elements. Furthermore, the low- 
frequency elements include a lot of information relating to 
adjacent blocks. The DCT does not consider the correlation 
between the blocks, and quantizes the low- frequency elements 
by blocks, thereby destroying continuity of the adjacent 
blocks. It is called the blocking artifacts. 

In addition, when the coefficients obtained by performing 
the DCT are quantized, as a quantization interval is 
increased, the elements to be coded are decreased, and thus 
the number of the bits to be processed is reduced. As a 



result, the information of the high-frequency element included 
in the original image is reduced, thereby generating 
distortion of the reconstructed image. It is called the 
ringing effects. The ringing effects generated by increasing 
the quantization interval are serious especially in a contour 
of an object in the reconstructed image. 

As techniques for removing the blocking artifacts and the 
ringing effects, employed are a low pass filtering method and 
a regularized image restoration method. 

According to the low pass filtering method, a plurality 
of pixels around a predetermined pixel are selected, and an 
average value thereof is computed. Here, a filter tap or 
filter coefficients are set by experience. For example, 
referring to Figure 2, there is provided a block of N*N size. 
Reference numerals A to F depict pixels. Pixels C, D are 
adjacent to a boundary of the block. In order to reduce 
irregular variations between the pixels C, D, a k-tap (here, 
7-tap) filtering is performed, and a threshold value replacing 
a D pixel value is computed according to local statistics. 
There is an advantage in that a computation amount is reduced 
by utilizing a predetermined threshold value according to the 
comparison with the local statistics. However, an adaptive 
processing power in accordance with a quantization parameter 
is deficient, and thus a screen quality of the restored image 
is excessively smoothed according to the kind of the images 



and compression ratio. 

The regularized image restoration method adaptively deals 
with the blocking artifacts in accordance with statistical 
properties of the image. That is, irregular information around 
5 the boundary of the block or in the block is all computed. 
However, the computed values form a matrix shape, and thus a 
real time processing is difficult due to the great computation 
amount. In addition, an average value obtained by a 
computation result of the irregular information is equally 

10 applied to the pixels, regardless of a degree of irregularity. 
Accordingly, when a block has a high degree of irregularity, 
it can be reduced. However, in case of a block having a low 
degree of irregularity, it may be increased. Thus, the system 
is not adaptive. Also, the information in the temporal section 

15 is not processed, and thus irregularity between the images 
cannot be adaptively processed. 

SUMMARY OF THE INVENTION 

2 0 It is therefore a primary object of the present invention 

to provide a method for restoring a compressed image of an 
image processing system and an apparatus therefor which can 
reduce the blocking artifacts and ringing effects generated in 
a restored image signal. 

25 It is another object of the present invention to provide 

5 



a method for restoring a compressed image of an image 
processing system and an apparatus therefor which consider a 
smoothing degree of an image and reliability for an original 
image by pixels having an identical property in image block 
5 units, during a decoding process. 

In order to achieve the above-described objects of the 
present invention, there is provided a method for restoring a 
compressed image of an image processing system including: a 
step of defining a smoothing functional having a degree of 
10 smoothing an image and reliability for an original image by 
pixels having an identical property in image block units; and 
a step of computing a restored image by performing a gradient 
operation on the smoothing functional in regard to the 
original image. 

15 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will become better understood with 
reference to the accompanying drawings which. are given only by 
2 0 way of illustration and thus are not limitative of the present 
invention, wherein: 

Figure 1 is a block diagram illustrating an image encoder 
according to a related art; 

Figure 2 illustrates pixels in order to explain a low 
25 pass filtering method carried out in the image encoder of 



Figure 1; 

Figure 3 is a block diagram illustrating an apparatus for 
restoring a compressed image of an image processing system in 
accordance with the present invention; 
5 Figure 4 illustrates a configuration of original pixels 

in a block of an original image in accordance with the present 
invention; 

Figure 5 illustrates directions of the irregular 
smoothing degree of the pixels in accordance with the present 
10 invention; 

Figure 6 illustrates an image moved and compensated in 
regard to a temporal section in accordance with the present 
invention; and 

Figure 7 illustrates a flowchart of the apparatus for 
15 restoring the compressed image of the image processing system 
in accordance with the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

2 0 Figure 3 is a block diagram illustrating an apparatus for 

restoring a compressed image of an image processing system in 
accordance with the present invention. As shown therein, a 
decoder 210 receives INTRA/ INTER information (p=mtype) , 
transmission information (t) , quantization information 

25 (qz=Qp) , a discrete cosine transform (DCT) coefficient (q) and 



motion vector information (v=MV; motion vector) from an 
encoder (as depicted in Figure 1) , and performs decoding. The 
encoder and the decoder 210 are connected by a communication 
channel or network. A post processing unit 220 receives image 
5 signals Y, U, V, a quantization variable (qz=Qp) , a macro 
block type (mtype) and a motion vector (v=MV) from the decoder 
210, and carries out an operation of restoring the compressed 
image in accordance with the present invention. 

According to the present invention, a smoothing 

10 functional is defined in regard to pixels having an identical 
property by blocks, a regularization parameter is computed 
based on the smoothing functional, and available values are 
applied to the regularization parameter, thereby obtaining an 
image to be restored. Thereafter, an iterative technique, a 

15 discrete cosine transform (DCT) , a projection and an inverse 
DCT are sequentially performed on the obtained image, thereby 
restoring a similar image to the original image. The whole 
processes will now be described in detail. 

2 0 Definition of Smoothing functional 

When an original image (f) is compressed and transmitted, 
an image (g) reconstructed in the decoder 210 is represented 
by the following equation. 



25 



g = f + n 



(1) 



Here, "g" and "f" indicate row vectors re-arranged in a 
stack-order, namely a scanning order, and "n" indicates a 
5 quantization error. When it is presumed that a size of the 
image is MxM, the original image (f ) , the reconstructed image 
(g) and (n) are column vectors having a size of Mxl . 

An original pixel for the original image (f) is 
represented by f (i,j) . Here, "i" and "j" indicate a position 
10 of the pixel in the image. 

Figure 4 illustrates configuration of the original pixels 
f (i,j) in the block of the original image (f) in order to 
explain the present invention. Reference numerals in Figure 4 
depict information of the respective pixels. 8x8 pixels are 
15 shown in a single block. 

The 8x8 pixels in the block are classified into the 
pixels having an identical property. That is, the pixels are 
divided in accordance with their position, vertical direction, 
horizontal direction and smoothing variation in the temppral 
2 0 section. Accordingly, it is defined that a set of the pixels 
positioned at a boundary of the block in a vertical direction 
is C VB , a set of the pixels positioned inside the block in the 
vertical direction is C vu , a set of the pixels positioned at 
a boundary of a block in a horizontal direction is C HB , a set 
25 of the pixels positioned inside the block in the horizontal 



direction is C HW , and a set of the pixels moved and compensated 
in the temporal section is C y . The sets C VB , C vw , C HB , C HW , C T are 
represented by the following expressions. 
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10 

Here, the set C T is a set of the pixels having a macro 
block type of "inter" or "not coded" in order to remove 
temporal redundancy information. 

The smoothing functional M(f) for using the 
S 15 regularization restoration method from the above -defined sets 
C VB , C vu , C HB , C HU , C T is defined as follows. 

M(f) = M VB (f) + M HB (f) + M w (f) + M HU (f) + M T (f) -- (3) 

20 Here, M VB (f) is a smoothing functional for the set C VB , 

M HB (f) is a smoothing functional for C HB , M vw (f) is a smoothing 
functional for the set C vu , M HW (f) is a smoothing functional 
for the set C HW , and M T (f) is a smoothing functional for the 
set C T . The smoothing fuctionals are respectively defined as 

25 follows. 
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M VB (f) 


= IIQ VB fll 2 


+ « VB ll 2 wi 




= IIQhb f ll 2 


+ a HB i9- f H 2 U2 




= II Q V w f H 2 


+ «vwll9- f 1 2 W3 


M Hy (f) 


= HQhw f H 2 


+ a Huii9- f H 2 W4 


M T (f) = 


= IIQ T f l 2 + 


a T llg-f|| 2 u5 



Here, first terms in each expression indicate a smoothing 
degree for the original pixel {reference pixel) and adjacent 
pixel, and second terms indicate reliability for the original 
10 pixel and the restored pixel. " || • II " indicates the Euclidean 
norm. Q VB , Q vw , Q HB , Q HW , Q T indicate high pass filters for 
smoothing the pixels in the sets C VB/ C vu| , C HB , C HU , C T . 

The first term at the right side is represented by the 
following expression. 

15 

j|Q ra f|| 2 = M Z'Z(f{m,n)-f(m-l,n) ) 2 ,173=0, 8 , 16 , . . . 

n=0m 

\\Q m f\ 2 = sV(f {m,n)-f (m r n-l) ) 2 ,n=0, 8, 16, . . . -- (5) 

nm=0 

20 

HQ^fll 2 = n(f(jn,n)-f(m-l,n) ) 2 , m*0,8, 16, . . . 
||0^f|| 2 = /x(f(m,n)-f(m f n-l)) 2 r n*0,8,16,... 

nm=0 

25 
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||e T f|| 2 = ZZ(f MC (m,n)-f(m,n)) 2 



The smoothing functionals represented by Expression (4) 
5 are quadratic equations, respectively. Thus, local minimizers 
of each smoothing functional become global minimizers. 

Figure 5 illustrates directions of the irregular 
smoothing degree of the pixels. There are a single pixel at 
the center and eight pixels therearound. There are also shown 

10 horizontal and vertical arrows starting from the pixel at the 
center. The arrows respectively depict the directions of the 
irregular smoothing degree in regard to the four adjacent 
pixels. That is to say, the irregular smoothing degree is 
considered in four directions in respect of a single pixel . 

15 Figure 6 illustrates an image moved and compensated in 

regard to the temporal section in accordance with the present 
invention. Arrows depict the correlation of a currently- 
restored image with a previously-restored image and a 
succeedingly reconstructed image, respectively. 

20 a VB , a HB , or vw , a HW , a T included in the second terms of 

Expression (4) are regularization parameters in regard to each 
set, indicate a ratio of the smoothing degree and reliability, 
and imply an error element. Wl , W2 , W3 , W4 , W5 indicate 
diagonal matrixes having a size of MxM in order to determine 

25 whether each set has an element, and have a value of "1" or 
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"0" according to whether each pixel is included in a 
corresponding set. That is, if the respective pixels are 
included in the corresponding sets, the value of the diagonal 
elements is "1". If not, the value of the diagonal elements is 
5 " 0 " . 

Thereafter, the regularization parameters, a VB , o; HB , a w , 
a HW , a T are approximated as follows. 

Approximation of Regularization Parameters 

10 

Approximation of the regularization parameters is a major 
element determining performance of the smoothing functional. 
In order to reduce the computation amount, presumptions are 
made as follows. 

15 (1) A maximum value of the quantization error generated in 

the quantization process of the DCT region is Qp, and thus it 
is presumed that the quantization variables Qp are regular in 
each macro block. For this, the maximum quantization error of 
the DCT coefficients of each macro block is regularly set to 

2 0 be Qp. 

(2) It is also presumed that the DCT quantization errors have 
the Gaussain distribution property in the spatial section. 



Under the above presumptions, in case a set theoretic is 
25 applied, each regularization parameter is approximated as 

13 



follows . 



Wg-ffm 



IIQvbStII 2 



WQ^gf 



\\g-f\\ 2 m ZZw 1 (m,n)Qp 2 (m,n) 



WQH B f\\ 2 



\\Qhb9\\ 2 
\\g-ff W2 



ll^gll 2 



ZZw 2 (m,n )Qp 2 {m,n) 



- (6) 



\\g-f\\ 2 m \\g-f\\ 2 w 3 T,Hw 2 {m r n)Qp 2 (m,n) 



WQ^gl 2 

ZZw 4 (m,n)Qp 2 (m,n) 

\\Q T g\\ 2 

ZZw 5 {m,n)Qp 2 (m,n) 

2 0 Here, Q 2 p (m,n) is a quantization variable of a macro block 

including a (m,n)th pixel of a two-dimensional image. 

In Expression (6) , denominator terms of the respective 
regularization parameters are a sum of the energy for the 
quantization noise of the elements included in each group. As 

25 described above, the values of the regularization parameters 
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Ilg-f|| 2 p« 
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may be easily computed by applying the set theoretic under the 
two presumptions. 

Computing Pixels to be Restored from Smoothing Functional 

5 

Only the original image needs to be computed. However, 
the smoothing functional includes a square term of the 
original image. Accordingly, in order to compute the original 
image, a gradient operation is carried out on the smoothing 
10 functional in regard to the original image. A result value 
thereof is "0", and represented by the following expression. 

V f M(f) = 2Q T VB Q VB + 2Q T HB Q HB + 2Q T W Q W + 2Q T HU Q HW + 2Q T T Q T 

- 2o! VB W T 1 W 1 (g-f ) - 2a HB W T 2 W 2 (g-f ) - 2a vw W T 3 W 3 (g- f ) -- (7) 
15 - 2a HW W T A W 4 (g-f ) - 2a T (g-f) = 0 

Here, a superscript "T" indicates a transposition of the 
matrix . 

A restored image^ similar to the original image (f) can be 
20 obtained by Expression (7) . However, operation of an inverse 
matrix must be performed, and thus the computation amount is 
increased. Thus, in accordance with the present invention, the 
restored image is computed by an iterative technique which 
will now be explained. 
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Iterative Technique 



When Expression (7) is iterated k times, an iterative 
solution f k+1 is represented by the following expression. 

f k+1 = f k + 3 [Ag - Bf k ] , 

A = a VB W 1 + a HB W 2 + a vw W 3 + a HU W 4 + a T W 5 --- (8) 

B = ^ t vb Qvb + Q t h B Q hb + Q T w Qvu + Q T mAw + Q T T Q T > + A 

In Expression (8) , "3" is a relaxation parameter having 
a convergence property. Expression (8) can be represented by 
the following expression by computing consecutive iterative 
solutions . 

(f k+1 - f k > = (I - B ) (f k - f k . 1 ) --- ( 9 ) 

Here, "I" is an identity matrix, and the matrix B has a 
positive definite property. Therefore, when the following 
condition is satisfied, the iterative solutions are converged. 

||I - B || < 1 (10) 

Expression (10) can be summarized as follows. 

0 < B < (11) 

H 1+max^fA) { x> 

16 



In Expression (11) , "A (A) " depicts an eigen value of the 
matrix A. A considerable amount of computation is required to 
compute the eigen value A (A) . However, the high pass filters 
have a certain shape determined according to the positions of 
the respective pixels, regardless of the image. Accordingly, 
before computing Expression (8), the eigen value A (A) can be 
replaced by a fixed value. The' value may be computed by a 
power method which has been generally used in interpretation 
of numerical values. 

For example, a computation process of an eigen value of 
an iterative solution will now be explained. 

X k+1 = 

Here, "x k " is a vector of Mxl, and " K" is a positive- 
definite symmetric MxM matrix. The eigen value A' of the 
matrix K is approximated as follows. 

In the above expression, if "k" is to infinity, the eigen 
value A' is approximated to a real value. 

Thus, the iterative solution represented by Expression 
(8) is computed. The next thing to be considered is a time of 



finishing the iterative technique, in order to determine the 
number of iteration. Here, two standards are set as follows. 

Firstly, a predetermined threshold value is set before 
starting iteration, an image obtained after iteration, namely 
5 a partially-restored image is compared with the previously- set 
threshold value, and it is determined whether the iteration 
technique is continuously performed according to a comparison 
result . 

Secondly, the iteration technique is performed as many as 

10 a predetermined number, and then finished. 

According to the first standard, a predetermined 
threshold value is set in performing iteration, and thus a 
wanted value is obtained. However, although the iteration 
number is increased, it may happen that the predetermined 

15 threshold value is not reached. On the other hand, the second 
standard is performed by experience, but can reduce a 
computation amount. Therefore, the two standards may be 
selectively used according to the design specification. 

Figure 7 is a flowchart of the apparatus fpr restoring 

2 0 the compressed image of the image processing system in 
accordance with the present invention. As shown therein, in 
the step SI, the quantization variable Qp and the image 
signals Y, U, V are inputted, and the regularizat ion parameter 
is approximated as described above. In the step S2 , the 

25 gradient operation is performed on the smoothing functional in 



regard to the original image. In the step S3, an iterative 
solution, namely a wanted restored image is obtained by the 
iteration technique. In this step, employed are the image 
signals Y, U, V and the motion vector MV which is moved and 
5 compensated. 

In the step S4 , the DCT is performed on the restored 
image corresponding to the iterative solution f k+1 obtained in 
the step S3. An (u,v)th DCT coefficient of the two-dimensional 
i3 restored image is expressed as F k+1 (u,v), and must exist in the 

10 following section in accordance with a property of the 
quantization process. 

G(u,v) - Qp s F k+1 (u,v) s G(u,v) + Qp (12) 

15 Here, "Qp" is a maximum quantization error as explained 

above, and "G(u,v)" is a two-dimensional DCT coefficient 
obtained by performing the DCT on the reconstructed image (g) . 
The DCT coefficients F k+1 (u,v) and G(u,v) are represented as 
follows. In Expression (13), "B" indicates a block DCT. 

20 

F k+1 (u,v) = (Bf k+1 ) (u, v) , and G(u,v) = (Bg)(u,v) -- (13) 

In the step S6, a section of the DCT coefficient of the 
restored image is set as in Expression (12) . Accordingly, in 
25 case the DCT coefficient F k+1 (u,v) of the restored image is not 

19 



in the predetermined section, it must be projected as follows. 
A projection process is carried out in the step S7, and 
represented by Expression (14) . 



5 P(F k+1 (u,v)) = 
P(F k+1 (u,v)) = 
P(F k+1 (u,v)) = 



G(u,v) - Qp, if F k+1 (u,v) 
G (u, v) + Qp, if F k+1 (u, v) 
F k+1 (u,v), otherwise. 



< G(u,v) - Qp 

> G(u,v) - Qp -- (14) 



Expression (14) will now be described. 

10 When F k+1 (u,v) is smaller than G(u,v) - Qp, the projected 

restored image P(F k+1 <u,v)) is mapped to G(u,v) - Qp . In case 
F k+1 (u,v) is greater than G(u,v) + Qp, the projected restored 
image P(F k+1 (u,v)) is mapped to G(u,v) + Qp . Otherwise, the 
projected restored image P (F k+1 (u, v) ) is mapped as it is. 

15 In the step S8, the inverse DCT is performed on the 

mapped image P(F k+1 (u,v)) in the spatial section. The finally 
restored image is represented by Expression (14) . 



f k+1 = B PBf k+1 (15) 

20 

Here, "B" indicates the DCT, "P" indicates mapping, and 
"B T " indicates the inverse DCT. 

The restored image is stored in a frame memory in the 
post processing unit 220 (Step S9) . The post processing unit 
2 5 22 0 performs motion compensation based on the motion vector MV 
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(Step S10) . The motion and compensation image is employed for 
generation of the regularization parameter for a succeeding 
image and the iteration technique. 

The post processing unit 22 0 outputs the restored motion 
5 and compensation image as a video signal to a display (not 
shown) (Step Sll) . 

As discussed earlier, the present invention can restrict 
a section of the restored image for the respective pixels by 
using the various regularization parameters. In addition, the 
10 present invention prevents flickering which may occur in the 
dynamic image compression technique. 

Consequently, the present invention adaptively prevents 
the blocking artifacts and the ringing effects for the pixels 
having an identical property in image block units, and thus 
15 can be widely used for the products of the hybrid MC-DCT 
mechanism. 

As the present invention may be embodied in several forms 
without departing from the spirit or essential characteristics 
thereof, it should also be understood that the above-described . 

20 embodiment is not limited by any of the details of the 
foregoing description, unless otherwise specified, but rather 
should be construed broadly within its spirit and scope as 
defined in the appended claims, and therefore all changes and 
modifications that fall within the meets and bounds of the 

25 claims, or equivalences of such meets and bounds are therefore 



intended to be embraced by the appended claims. 



5 



10 



15 



20 
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What is claimed is: 



1. A method for restoring a compressed image of an 
image processing system, comprising: 

5 a step for defining a smoothing functional having a 

smoothing degree of an image and reliability for an original 
image by pixels having an identical property in image block 
units; and 

a step for computing a restored image by performing a 
10 gradient operation on the smoothing functional in regard to 
the original image. 

2. The method according to claim 1, wherein the step 
for defining the smoothing functional divides the pixels 

15 according to their position, horizontal direction, vertical 
direction and smoothing variation in a temporal section. 

3. The method according to claim 1, wherein the 
.smoothing functional M(f) comprises a sum of a smoothing 

20 functional M^Cf) for pixels positioned at the boundary of a 
block in a vertical direction, a smoothing functional M vg (f) 
for pixels positioned inside the block in a horizontal 
direction, a smoothing functional M HB (f) for pixels positioned 
at the boundary of a block in a horizontal direction, a 

25 smoothing functional M HU (f) for pixels positioned inside the 

23 



block in a horizontal direction, and a smoothing functional 
M T (f) for pixels moved and compensated in the temporal 
section, "f" indicating the original image. 



5 4. The method according to claim 3, wherein the 

smoothing functionals M VB (f), M HB (f), M vw (f), M HW (f), M y (f) are 
defined as; 



M VB (f) : 


- HQVB 


fll 2 


+ a VB ll9-f II 2 U1 


M HB< f ) = 


= IIQhb 


f II 2 


+ a H B iig- f « 2 U2 


M w (f) : 


= HQvw 


fll 2 


+ QivuBg-f Il 2 u3 


M HU ( f ) = 


= H Q HW 


f II 2 


+ a„ w U9- f H 2 u4 


M T (f) = 


II Q T f 


II 2 + 


or T ll^-f li 2 w5 



15 Q VB , Q vw , Q HB , Q HU , Q T indicating high pass filters for 

smoothing the respective pixels, a VB , or HB , o; vw , o; HU , a T being 
regularization parameters, g being a reconstructed image, and 
Wl, W2 , W3 , W4 , W5 indicating diagonal matrixes for 
determining whether each group has an element. 

20 

5. The method according to claim 1, wherein the step 
for computing the restored image comprises a step for 
approximating the regularization parameter by applying a set 
theoretic, and it is presumed that the quantization variables 
25 of the DCT region are regular in each macro block, and also 
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presumed that the DCT quantization errors have the Gaussain 
distribution property in the spatial section. 



6. The method according to claim 5, wherein the 
5 regularization parameters are approximated as; 



lie^ll 2 


\\Qvb9W 2 


WQ^gt 






llg-^ll 2 ^ 


\\g-f\\ 2 m 


ZZw 1 (m,n)Qp 2 


(m, 


■ n) 


lie^ll 2 


llo HB g|| 2 


no^gn 2 






\\g-f\\ 2 w2 


Wg-ffm 


SSw 2 {m,n )Qp 2 


' (137 , 




WQvwff 


licwgll 2 


WQ^gf 






\\g-f\\ 2 w3 


\\g-ffm 










\\Q HW gt 


IIO^II 2 






\\g-f\\\ 4 


\\g-ff w4 


T.T.w 4 {m l n)Qp' 


'■ (m, 


rn) 


\\Q T f\\ 2 


\\Q T g\ 2 


\\Q T g\ 2 






llg-fll 2 ^ 


\\g-ff W5 


T,T,w 5 (m,n)Qp 2 


(m, 


n) 



Q 2 p (m,n) indicating a quantization variable of a macro 
block including an (m,n)th pixel of a two-dimensional image. 
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7. The method according to claim 1, wherein a local 
minimizer of the smoothing functional is a global minimizer. 

8. The method according to claim 1, wherein the 
5 regularization parameter indicates a ratio of a smoothing 

degree of the image and reliability for the original image. 

9. The method according to claim 1, further comprising 
a step for computing an iterative solution in regard to a 

10 restored image, after computing the restored image. 

10. The method according to claim 9, wherein the 
iterative solution f fe+1 is represented by; 

15 f k+1 = f k + (3 [Ag - Bf k ] , 

A = a VB W 1 + a HB W 2 + a vw W 3 + <* HU W 4 + o< T W 5 

B = (Q T VB Q VB + Q T HB Q HB + Q T VU Q VU + Q T HH Q HU + Q T T Q T ) + A 

and, 3 is a relaxation parameter having a convergence 

2 

2 0 property, and computed at the range of 0</3< , an 

^ l+max i X i (A ) 

eigen value A (A) of the matrix A being replaced by a fixed 
value . 

11. The method according to claim 9, wherein a 
25 predetermined threshold value is set in computing an iterative 
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solution, an image obtained after iteration is compared with 
the previously- set threshold value, and it is determined 
whether the iteration technique is continuously performed 
according to a comparison result, or the iteration is finished 
5 after the iteration technique is performed as many as a 
previously- set number. 

12. The method according to claim 9, further comprising 
a step for obtaining a mapped image by projecting a two- 

10 dimensional DCT coefficient of the restored image 
corresponding to a computed iterative solution, and for 
performing an inverse DCT on the mapped image. 

13. The method according to claim 12, wherein the step 
15 for obtaining the mapped image is mapping a projected restored 

image P(F k+1 (u,v)) to G(u,v) - Qp when the DCT coefficient of 
the restored image F k+1 (u,v) is smaller than G(u,v) - Qp, 
mapping the projected restored image P(F k+1 (u,v)) to G(u,v) + 
Qp when F k+1 (u,v) is greater than G(u,v) + Qp, and otherwise 
20 mapping the projected restored image P(F k+1 (u,v)) as it is, 
G(u,v) indicating a two-dimensional DCT coefficient obtained 
by performing the DCT on the reconstructed image, and Qp 
indicating quantization information. 

25 14. An apparatus for restoring a compressed image of an 
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image processing system, comprising: 

a decoder for decoding a coded image signal, and for 
outputting information of the restored image, such as the 
decoded image, a quantization variable, a macro block type and 
5 a motion vector; and 

a post processing unit for including the information of 
the restored image inputted from the image decoder, for 
defining a smoothing functional including a smoothing degree 
of the image and reliability of an original image by pixels 
10 having an identical property in image block unit, and for 
performing a gradient operation on the smoothing functional in 
regard to the original image, 

the smoothing functional including a regularization 
parameter having weight of reliability for the original image. 

15 



20 
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ABSTRACT OF THE DISCLOSURE 

The present invention relates to an image processing 
technique, and in particular to a method for restoring a 
5 compressed image by using a hybrid motion compensation 
discrete cosine transform (hybrid MC/DCT) mechanism, 
including: a step of defining a smoothing functional having a 
smoothing degree of an image and reliability for an original 
image by pixels having an identical property in image block 
10 units; and a step of computing a restored image by performing 
a gradient operation on the smoothing functional in regard to 
the original image, thereby preventing the blocking artifacts 
and the ringing effects in regard to the pixels having an 
identical property in image blocks. 

15 
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